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(54) Digital imaging method and apparatus for detection of document security marks 



(57) The present invention provides in one aspect a 
method of digitally processing images, comprising the 
steps of: potentially including in a printed document a 
security mark defined by a plurality of actual mark con- 
stituents, processing the image data to identify potential 
constituents, for each potential mark constituent repre- 
sented by said digital image data, determining if said 
potential mark constituent, together with at least one 
other potential mark constituent represented by said 
digital data, defines a potential security mark, and, for 
each potential security mark represented in said digital 
image data, determining if said potential security mark 
represents an actual security mark present in said 
printed document. In a second aspect there is provided 
a digital image processing method for preventing unau- 
thorized reproduction of a printed document. In a third 
aspect there is provided a method of processing digital 
image data representing a color printed document that 
includes a security mark. 
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Description 

[0001] The proliferation of digital image processing 
systems, such as digital color copiers, that are able to 
make very high quality reproductions or "copies" of 
color documents at a low cost has led to use of these 
machines by criminals for reproduction of currency, 
checks, stock certificates, legal documents, and other 
printed documents not legally reproducible. Obviously, 
any reproductions of these documents are counterfeit 
and illegal. Unfortunately, there has heretofore not been 
found a method or apparatus for effectively and effi- 
ciently detecting the attempted reproduction of currency 
and the like so that the reproduction may be thwarted. 
Without an effective an efficient method/apparatus for 
detecting currency and other non-reproducible docu- 
ments, criminals have often been able to produce coun- 
terfeit documents almost at will. 
[0002] Many difficulties are presented during the 
attempted identification of a security mark in a printed 
document. The documents, such as currency, are often 
significantly worn. Also, the document may be placed in 
the reproduction apparatus at an irregular angle or loca- 
tion that renders detection of the security mark more dif- 
ficult Also, improper or erroneous detection of a 
security mark, and any resulting operations to prevent 
duplication of the document, are likely to upset and 
inconvenience those attempting to make legitimate 
reproductions. Accordingly, erroneous detection of a 
security mark in a document must be minimized. 
[0003] In accordance with the present invention, a 
new and improved digital imaging method and appara- 
tus are provided for effective and efficient detection of 
document security marks to prevent counterfeiting of 
documents. 

[0004] In accordance with a first aspect of the 
present invention, a method of digital image processing 
is provided. The method includes, for a printed docu- 
ment potentially including a security mark defined 
therein by a plurality of actual mark constituents each 
having a select color, size, and shape and having a 
select spatial arrangement relative to each other, scan- 
ning the document to obtain digital image data corre- 
sponding to the printed document, the digital image 
data defined in terms of a plurality of color input pixel 
values. The digital image data is processed to identify 
all portions representing potential constituents of a 
security mark. For each potential mark constituent rep- 
resented by the digital image data, it is determined if the 
potential mark constituent, together with at least one 
other potential mark constituent represented by the dig- 
ital image data, defines a potential security mark. For 
each potential security mark represented in the digital 
image data, it is determined if the potential security 
mark represents an actual security mark present in the 
printed document. 

[0005] In accordance with another aspect of the 
present invention, a digital image processing method for 



preventing unauthorized reproduction of a printed docu- 
ment including a security mark defined in terms of a plu- 
rality of actual mark constituents having a select color, 
select dimensions and arranged in a select pattern rela- 

5 tive to each other, includes scanning said printed docu- 
ment to derive color digital data representing the printed 
document, the color digital data defined in terms of a 
plurality of pixels each having a color value. All pixels of 
the color digital data having a color value representing a 

to color at least approximating the select color of the plu- 
rality of actual mark constituents are identified. A binary 
map of the color digital data is constructed and defined 
in terms of "on" and "off pixels, the "on" pixels corre- 
sponding to the identified pixels of the color digital data 

is having color values at feast approximating the select 
color of the plurality of actual mark constituents. The 
binary map is used to identify potential mark constitu- 
ents defined by the "on" pixels and to identify at least 
one neighborhood of plural potential mark constituents 

20 together defining a potential security mark. The poten- 
tial security mark is identified as an actual security mark 
if the potential mark constituents thereof are uniform rel- 
ative to each other. If an actual security mark is identi- 
fied, effective duplication of the printed document is 

25 prevented. 

[0006] In accordance with still another aspect of the 
present invention, a method of processing digital image 
data representing a color printed document that 
includes a security mark for purposes of identifying the 

30 security mark represented in the digital image data 
includes processing the digital image data to identify all 
portions thereof defining a select color corresponding to 
the color of the security mark in the printed document. 
For each portion of the digital image data defining the 

35 select color, it is determined if the portion represents a 
potential constituent of a security mark in the printed 
document. The method further includes, for each poten- 
tial security mark constituent identified in the digital 
image data, determining if the potential security mark 

40 constituent, together with at least one other potential 
security mark constituent, defines a potential security 
mark. The potential security mark constituents defining 
each potential security mark are compared to each 
other to determine if they are uniform in terms of color 

45 and size relative to each other. A potential security mark 
is identified as a security mark represented in the digital 
image data if the potential security mark constituents of 
the potential security mark are sufficiently uniform in 
terms of the least color and size relative to each other. 

50 [0007] In accordance with another aspect of the 
present invention, a document reproduction security 
method includes scanning a printed document to derive 
color digital image data representative of the printed 
document The digital image data is processed to iden- 

55 tify all pixels thereof in a select color range used to 
define a security mark in the printed document The dig- 
ital image data is also processed to identify all con- 
nected components comprising only pixels of the digital 
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image data in the select color range. The digital image 
data is processed to identify, as potential mark constitu- 
ents, all of the connected components having both a 
size and shape corresponding to a predefined size and 
shape of actual mark constituents defining the security 
mark in the printed document. The digital image data is 
further processed to establish a neighborhood of a 
select size about each potential mark constituent and to 
identify, as a potential security mark, all neighborhoods 
comprising: (i) a number of potential mark constituents 
greater than or equal to a minimum and less than or 
equal to a maximum number of actual mark constituents 
required to define a security mark; and (ii) potential 
mark constituents arranged relative to each other in a 
manner corresponding to the actual mark constituents 
defining the security mark in the printed document. For 
each neighborhood identified as a potential security 
mark, the digital image data is further processed to 
identify the potential security mark as an actual security 
mark if the potential mark constituents in the neighbor- 
hood are uniform in terms of at least size and color. 
Effective reproduction of the printed document is pre- 
vented if the digital image data includes an actual secu- 
rity mark. 

[0008] - One advantage of the present invention is 
the provision of a digital imaging document security 
mark detection method and apparatus that effectively 
and efficiently detect document security marks upon 
attempted digital reproduction of a printed document 
including a security mark to prevent production of coun- 
terfeit documents. 

FIGURE 1 is a block diagram illustrating an image 
processing system in accordance with the present 
invention; 

FIGURE 2A illustrates a printed document such as 
a currency note, including a security mark; 
FIGURES 2B and 2C show enlarged portions of the 
document illustrated in FIGURE 2 A for purposes of 
showing the features of the security mark; 
FIGURE 3 is a flow-chart illustrating an overall dig- 
ital image processing method for detecting docu- 
ment security marks in accordance with the present 
invention; 

FIGURE 4 is a more detailed flow-chart illustrating 
a digital image processing method of detecting doc- 
ument security marks in accordance with the 
present invention; 

FIGURE 5A is a flow-chart illustrating the binariza- 
tion step of a digital image processing method for 
detection of document security marks in accord- 
ance with the present invention; 
FIGURE 5B illustrates the binary data resulting 
from application of the binarization method of FIG- 
URE 5A to the digital image data obtained from the 
printed document of FIGURE 2A; 
FIGURE 6A is a flow-chart illustrating the micro- 
detection step of a digital image processing method 



for detecting document security marks in accord- 
ance with the present invention; 
FIGURE 6B diagrammaticalty illustrates a method 
of identifying connected components of binary 
5 image data in accordance with the present inven- 

tion; 

FIGURE 6C diagram matically illustrates evaluation 
of connected component size in accordance with 
the present invention; 

io FIGURE 6D diagrammatical ly illustrates a con- 
nected component template matching operation in 
accordance with the present invention; 
FIGURE 6E illustrates the portions of the binary 
image data of FIGURE 5B that correspond to 

15 potential constituents of a security mark in the 
printed document of FIGURE 2A; 
FIGURE 7A is a flow-chart illustrating a macro- 
detection operation of a digital image processing 
method for detecting document security marks in 

20 accordance with the present invention; 

FIGURE 7B illustrates the portions of the binary 
image data of FIGURE 5B that correspond to 
potential security marks in the printed document of 
FIGURE 2A; 

25 FIGURE 8 illustrates a verification operation of a 
digital imaging method for detecting document 
security marks in accordance with the present 
invention; and, 

FIGURE 9 is a flow-chart illustrating control of the 
30 digital image processing system to prevent effective 
duplication of a document including a security 
mark. 

[0009] A digital image processing system 10 in 

35 accordance with the present invention is shown in FIG- 
URE 1 . An image input scanner 12 derives and delivers 
digital image data in the form of one or more monochro- 
matic separations, wherein the picture elements or pix- 
els of each separation are defined at a depth of d bits 

40 per pixel where d is an integer. Accordingly, each pixel 
of each separation is defined in terms of d bits per pixel 
(bit depth = d), and each pixel has some gray value 
between full off and full on. When the digital image data 
is provided in terms of a single monochromatic separa- 

45 tion, the image is monochromatic, for example, so 
called black-and-white image data. On the other hand, 
when the digital image data is provided in terms of two 
or more monochromatic separations, a color image 
results when the data from the separations is combined, 

so for example, red-green-blue (RGB) separations or cyan- 
magenta-yellow (CMY) separations. 
[0010] The image signals are input from the scan- 
ner 12 to an image processing unit 14 wherein digital 
image processing, such as security mark identification 

55 in accordance with the present invention, is performed. 
The image processing unit 14 may be provided by any 
suitable electronic computing apparatus such as an 
electronic computer, a dedicated electronic circuit, or 



3 



5 



EP 1 059 800 A2 



6 



any other suitable electronic circuit means. The image 
processing unit 14 outputs data in a suitable format to 
an image output terminal 16 such as a digital printer 
and/or visual display. Suitable apparatus for digital 
image input and/or output include the XEROX Docu- 
ment Center 265DC digital imaging system, Pixelcraft 
7650 Pro Imager Scanner, XEROX DocuTech Produc- 
tion Printing System scanners, the XEROX 5775 digital 
color copier, the XEROX 5760 and 5765 Majestik digital 
color copiers, or any other suitable color digital scan- 
ner/copier. Regardless of the depth d at which each 
pixel is defined, the location of each pixel in each sepa- 
ration bitmap is also defined, typically in terms of a row 
"n" and a column "m." 

[0011] Rgure 2A illustrates a currency note includ- 
ing a security mark imprinted or otherwise included 
thereon. The illustrated currency note and security mark 
are for ease of illustrating the invention only, and those 
of ordinary skill in the art will recognize that the inven- 
tion is equally applicable to any type of document 
including any suitable security mark thereon. As noted, 
checks, stock certificates, bonds, and legal documents 
are some other examples of documents that may 
include security marks and that may, consequently, be 
protected from unauthorized reproduction according to 
the present invention. 

[0012] The currency note 20 is printed on paper 22 
or other suitable substrate and comprises various mark- 
ings, such as denomination markings 24, text 26, vari- 
ous decorative images and designs 28, and a security 
mark SM used to identify the currency note 20 as an 
authentic document. As illustrated and described 
herein, the security mark SM is printed in the same or 
similar manner on the document 20 as the information 
24, 26, 28, typically using any suitable color ink. 
[0013] With reference now to FIGURES 2B and 2C, 
the portion of the currency note 20 including the security 
mark SM is illustrated and greatly enlarged to show the 
characteristics of the security mark SM used in the 
present example. As noted, in practice, the security 
mark will likely take any one of a wide variety of alterna- 
tive forms, and the invention is not to be limited to the 
illustrated or any other particular security mark In the 
present example, the security mark SM is defined on 
the note 20 (according to a definition promulgated by 
the appropriate authorities) by three identical mark con- 
stituents MC, each having identical size, shape and 
color according to the security mark definition. Also, the 
mark constituents MC are arranged in a select pattern 
or arrangement as required by the definition of the secu- 
rity mark SM. As illustrated herein, the mark constitu- 
ents MC are circular and arranged at the vertices of a 
right triangle. The mark constituents MC are separated 
from each other by the distances D1, D2, D3, to define 
the security mark SM further as having a select overall 
size and shape. 

[0014] The apparatus and method in accordance 
with the present invention operate the image processing 



unit 14 to detect the existence of a security mark SM in 
a document such as the note 20 scanned by the image 
input scanner 12 so that the image processing unit can 
prevent or inhibit unauthorized reproduction of the note 
5 20 or other document being scanned. Those of ordinary 
skill in the art will also recognize that the subject method 
hand apparatus may be used to determine the authen- 
ticity of a document. 

[0015] With reference now to FIGURE 3, a pre- 
w f erred digital image processing method for detection of 
document security marks is illustrated in accordance 
with the present invention. The security mark detection 
method as implemented using the digital imaging 
processing system 10 comprises: S1 - obtaining a dig- 
is ital input image, typically through use of the image input 
scanner 12; S2 - binarization of the digital input image; 
S3- micro-detection; S4 - macro-detection; S5 - verifica- 
tion; and S6 -prevention of the effective reproduction of 
the input document if a security mark is found. The 
20 operations S2 through S6 are preferably carried out in 
the image processing unit 14. 

[0016] The operations S1-S6 are illustrated in fur- 
ther detail in FIGURE 4. The step S1 comprises scan- 
ning an input printed document, such as the currency 

25 note 20, using the input image scanner 12 to derive 
color digital image data in terms of multiple color sepa- 
rations in a suitable color space, e.g., red R, green G, 
blue B, or the like. The scanner 12 may derive or deliver 
the digital image data in terms of any other suitable 

30 color space. 

[0017] The binarization step S2 comprises a first 
sub-step S2a of identifying all pixels in the input digital 
image as derived by the scanner 12 having or repre- 
senting a color in a select range. A second sub-step 

35 S2b constructs a bitmap corresponding to all pixels of 
the input digital image identified as having a color in the 
select range. 

[0018] The micro-detection operation S3 comprises 
sub-steps S3a-S3c. More particularly, using the bitmap 

40 derived from the binarization operation S2, "connected 
components" in the bitmap are determined S3a, and 
those of a size or shape not corresponding to a mark 
constituent MC are discarded S3b. Remaining con- 
nected components are identified as potential mark 

45 constituents S3c. 

[0019] In the macro-detection operation S4, poten- 
tial mark constituents in neighborhoods of other poten- 
tial mark constituents that are over-populated or under- 
populated relative to a number of mark constituents MC 

so defining a security mark SM are disregarded S4a. All 
remaining potential mark constituents tat are not prop- 
erly spaced from or arranged relative to their neighbor 
potential mark constituents are also disregarded S4b, 
and only those still remaining are identified as potential 

55 security marks S4c. 

[0020] Thereafter, ail potential security marks are 
further analyzed for uniformity, e.g., uniformity of color, 
uniformity of size, and those that are not sufficiently uni- 
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form are discarded S5a. Any remaining potential secu- 
rity marks are positively identified as actual security 
marks SM. If an actual security mark SM is identified, 
the image processing unit 14 prevents effective duplica- 
tion of the document scanned on the image input scan- 5 
ner 12, e.g., by completely terminating the digital image 
processing operation, by inserting a "VOID" message or 
the like in the output data sent to the image output 
device 1 6, or by otherwise failing to output an exact rep- 
lica of the input document, such as the currency note 10 
20. 

[0021 ] The operations S1 -S6 will now be described 
in further detail with reference to the currency note 20. 
In accordance with the operation S1, the currency note 
20 is scanned to obtain digital image data representing 15 
same in a suitable color space. This digital image data 
is fed to the image processing unit 14 for carrying out 
the operations S2-S6 in accordance with the present 
invention. 

[0022] With reference to FIGURES 5A and 5B, the 20 
binarization operation S2 comprises constructing a bit- 
map 30 defined by a plurality of pixels corresponding 
respectively in location to the plurality of pixels defining 
the input digital image of the currency note 20. To con- 
struct the bitmap 30, the color of each pixel defined by 25 
the input digital image is examined by the sub-step S2a 
to identify each pixel having a color in a select range 
corresponding to the color used for the actual mark con- 
stituents MC in the security mark SM. For each pixel of 
input image data in the proper color range, a sub-step 30 
S2b-1 sets the correspondingly located pixel in the bit- 
map to 1 or "on." All other pixels in the bitmap are set to 
0 or "off" by the sub-step S2b-2. Of course, an initializa- 
tion sub-step may alternatively be used to set all pixels 
in the bitmap 30 "off" prior to the color-checking sub- 35 
step S2a. Using the binary digits "1" and "0" to repre- 
sent "on" and "off" conditions corresponds with conven- 
tional computer science notation. Of course, the binary 
digits "0" and "1 8 may alternatively represent "on" and 
"off respectively, and the invention is not intended to be 40 
limited to either notation. 

[0023] Those of ordinary skill in the art will also rec- 
ognize that many different methods exist for determin- 
ing if a color of a pixel defined by values selected from a 
particular color space falls within a select color range, 45 
i.e., whether the color defined for a pixel in a particular 
color space is "close enough" to a desired color. If the 
distance of the actual color from the desired color is 
greater than a color range threshold T, then the actual 
color is outside of the range and not "close enough" to so 
the desired color. For example, if the pixels of the input 
digital image representing the currency note 20 are 
each defined by the actual red, green, and blue values 
(R,G,B), and if a pixel of a desired color is defined by 
desired red, green, blue values (R 1 , G\ B'), then the dis- 55 
tance of the color defined by the actual red, green, blue 
values R.G.B from the desired color defined by the red, 
green blue values (R'.G'.B*) may be calculated and com- 



pared to the threshold T according to: 



T>J(R-R % ) 2 + (G-G') 2 + (B-B 1 ) 2 

Of course, those of ordinary skill in the art will recognize 
that alternative methods exist for determining whether a 
color value of a pixel of a digital image is within a select 
color range. The preferred method will vary depending 
upon the particular color space by which the pixel is 
defined. It is not intended that the present invention be 
limited to any particular color comparison method or 
any particular color space. 

[0024] Referring now more particularly to FIGURE 
5B, the bitmap 30 resulting from binarization S2 of the 
input digital image derived by the scanner 1 2 for the cur- 
rency note 20 is illustrated. For each pixel of the input 
digital image derived by the scanner that represents a 
color in a select color range encompassing the color 
used to print the security mark SM, the bitmap 30 is 
defined by a correspondingly located "on" pixel. One or 
more of these "on" pixels are generally identified at 34 in 
FIGURE 5B. Likewise, all other pixels defining the bit- 
map remain or are set to an "off condition. These "off" 
pixels are collectively identified at 32 in FIGURE 5B. 
Accordingly, the bitmap 30 includes or identifies only 
those pixels from the input digital image that represent a 
color in the select color range that approximates the 
actual color of the constituents MC of the security mark 
SM. 

[0025] The bitmap 30 is further processed accord- 
ing to the micro-detection operation S3 as illustrated in 
FIGURES 6A-6D in accordance with the present inven- 
tion. A first sub-step S3a identifies all "connected com- 
ponents" in the bitmap 30. The operation of identifying 
connected components, by itself, from digital image 
data such as the bitmap 30 is a conventional operation 
and well known to those of ordinary skill in the art of dig- 
ital image processing, in particular, the art of optical 
character recognition (OCR). In the preferred embodi- 
ment illustrated herein, connected components in the 
bitmap 30 are identified as illustrated in FIGURE 6B. 
Each "on" pixel 34 of the bitmap 30 is placed in the 
center cell 38 of a 3x3 pixel matrix 36. All other "on" pix- 
els 34 encompassed in the matrix 36 are deemed to be 
part of the connected component CC including the pixel 
34 in the central matrix cell or location 38. Therefore, 
each connected component CC of the bitmap 30 com- 
prises a single "on" pixel 34 or a group of "on" pixels 34, 
wherein the pixels defining the group are each immedi- 
ately adjacent to at least one other pixel in the group. 
[0026] Once each connected component CC in the 
bitmap 30 has been identified, each connected compo- 
nent CC is further examined by sub-steps S3b-1 ,S3b-2 
to determine if the connected component is a potential 
mark constituent Referring also now to FIGURE 6C, the 
sub-step S3b-1 performs a size-checking operation on 
each connected component CC to determine if either its 
column width X or row height Y either (1) exceeds or (2) 
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fails to meet the size of a mark constituent MC. If the 
connected component CC under consideration by the 
sub-step S3b-1 is too large or too small in either dimen- 
sion, it is bypassed. Preferably, the size checking sub- 
step S3b-1 compares the width/height dimensions of 
each connected component CC to acceptable 
width/height size ranges rather than a select fixed value 
to account for printing, scanning, and other variations. 
[0027] Each connected component CC that satis- 
fies the size requirements of the sub-step S3b-1 must 
also survive a template-matching sub-step S3b-2 
wherein the connected component CC is compared to 
and must match at least one template of an actual mark 
constituent in order for the connected component to be 
deemed a potential mark constituent b. This template- 
matching operation is diagrammatically illustrated in 
FIGURE 6D. Both of the connected components CC1 
and CC2 satisfy the size checking sub-step S3b-1. 
Thus, each is then compared to a template 40 including 
a plurality of cells 42. Certain cells 42 of the template 40 
are target cells 44, arranged in the shape and size of a 
mark constituent MC. In order for a connected compo- 
nent CC1.CC2 to match a template, the template is 
overlaid with the connected component, and at least a 
select percentage of the target cells 44 must match or 
correspond to the pixels 34 defining the connect compo- 
nent CC1 ,CC2. Again, to account for printing, scanning, 
and other variations, a perfect template match is prefer- 
ably not required. In FIGURE 6D, the connected compo- 
nent CC1 matches the template 40, while the connected 
component CC2 does not Accordingly, the sub-step 
S3c identifies only the connected component CC1 (and 
all other connected components that satisfy the tem- 
plate-matching operation S3b-2) as a potential mark 
constituent PMC as illustrated in FIGURE 6E. 
[0028] Referring now to FIGURES 7A and 7B, the 
bitmap 30 is further processed according to the macro- 
detection operation S4 in an effort to determine which, if 
any, of the potential mark constituents PMC, with other 
potential mark constituents, defines a potential security 
mark PSM. As noted with reference to FIGURE 2C, an 
actual security mark SM is defined by actual marked 
constituents MC arranged in a specific pattern and 
spaced from each other by the distances D1 ,D2,D3. 
[0029] Using this information, which is obtained 
from the definition of the security mark SM, and for each 
potential mark constituent PMC, the sub-step S4a-1 
establishes a neighborhood about the potential mark 
constituent having a radius equal to or minimally larger 
than the maximum of the distances D1,D2,D3. A sub- 
step S4a-2 determines the number of potential mark 
constituents PMC in the neighborhood, including the 
central or main potential mark constituent about which 
the neighborhood is established. The sub-step S4a-2 
compares the number of potential mark constituents in 
the neighborhood to the number required to define a 
security mark. If a neighborhood has too many or too 
few potential mark constituents compared to the 



10 

number required to define a security mark, a sub-step 
S4a-3 disregards or bypasses the potential mark con- 
stituent about which the neighborhood is based, and 
another potential mark constituent PMC is examined 
5 beginning at the sub-step S4a-1 . 

[0030] On the other hand, if the neighborhood 
established about a potential mark constituent PMC 
comprises the number of potential mark constituents 
required to define a security mark SM, the neighbor- 
to hood is further examined by the sub-step S4b-1 . Prefer- 
ably, to account for the presence of "noise" potential 
mark constituents PMC, a neighborhood with one or two 
extra potential mark constituents relative to the number 
required to define a security mark SM is deemed to sat- 
15 isfy the sub-step S4a-2 so as to be further processed by 
the sub-step S4b-1 rather than discarded. 
[0031] For neighborhoods having an acceptable 
number of potential mark constituents PMC, the sub- 
step S4b-1 determines the distances between each 
20 potential mark constituent and its neighbors. The sub- 
step S4b-1 then compares these distances to the pre- 
defined distances D1,D2,D3 of the security mark SM. 
The distances between potential mark constituents 
PMC in a neighborhood must equal or be a super-set of 
25 the distances D1 ,D2,D3 plus or minus a margin of error 
to account for printing, scanning, or other variations. If 
not, the sub-step S4a-3 disregards or bypasses the 
potential mark constituent PMC about which the neigh- 
borhood is based, and the next potential mark constitu- 
te ent is examined beginning with the sub-step S4a-1 . 
[0032] However, if the distances between potential 
mark constituents PMC in a neighborhood equal or are 
a super-set of the distances D1,D2,D3, a sub-step S4b- 
2 discards any noise potential mark constituents PMC in 
35 the neighborhood and determines the position of the 
remaining potential mark constituents PMC in the 
neighborhood relative to each other and compares 
same to the relative position of the mark constituents 
MC defining an actual security mark SM. More particu- 
40 larly, the sub-step S4b-2 identifies and then discards 
noise potential mark constituents PMC from a neighbor- 
hood based upon the distances determined by the sub- 
step S4b-1. Any potential mark constituents PMC not 
relevant to the result of obtaining the distances 
45 D1 ,D2,D3 is deemed to be noise and discarded. 

[0033] The sub-step S4b-2 determines the relative 
positions of the potential mark constituents PMC in a 
neighborhood, and compares same to the security mark 
SM using any other wide variety of methods. A preferred 
so method, which operates independent of any rotation or 
other shift due to scanning variations at the image input 
scanner 1 2 is to use the distances as determined by the 
sub-step S4b-1. In such case, the potential mark con- 
stituents PMC in the neighborhood are examined to 
55 determine if the distances separating the potential mark 
constituents are arranged in the same sequence as the 
distances D1,D2,D3 of a security mark SM. Such a 
method operates independently of the vertical, lateral, 
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or rotational placement of the potential mark constitu- 
ents PMC in the bitmap 30. By way of example, two 
neighborhoods 50,52 (FIGURE 6E) of potential mark 
constituents PMC satisfy the distance requirements of 
the sub-step S4b-1 . However, when the sub-step S45-2 
examines the relative positions of the potential mark 
constituents PMC of each neighborhood 50,52, only the 
neighborhood 50 satisfies the requirement that the 
potential mark constituents PMC be positioned relative 
to each other as illustrated in FIGURE 2C - with the dis- 
tances D1,D2,D3 encountered sequentially when the 
potential mark constituents PMC are examined in a 
clockwise order. In an alternative embodiment, each 
potential security mark PSM is matched against a 
series of security mark templates, wherein the tem- 
plates are devised so that, if the potential security mark 
represents an actual security mark, one template will be 
matched regardless of any rotational shift of the constit- 
uents of the potential security mark - i.e., the entire 
potential security mark will be compared to a template 
of an actual security mark, wherein the templates 
encompass every possible rotational arrangement in 
which the constituents of the potential security mark 
could define an actual security mark. 
[0034] If a neighborhood does not satisfy the sub- 
step S4b~2, the sub-step S4a-3 bypasses the potential 
mark constituent PMC about which the neighborhood is 
established and another potential mark constituent 
PMC is processed beginning with the sub-step S4a-1 . 
On the other hand, if a neighborhood satisfies the sub- 
step S4b-2, the sub-step S4c identifies the neighbor- 
hood as a potential security mark PSM (FIGURE 7B), 
and processing in accordance with the macro-detection 
operation S4 continues at S4a-1 for the next potential 
mark constituent PMC not already part of a potential 
security mark PSM. 

[0035] If the macro-detection operation S4 results 
in the identification of any potential security marks PSM, 
processing continues with a verification operation S5 in 
accordance with the present invention as illustrated in 
FIGURE 8. Because the binarization S2, micro-detec- 
tion S3, and macro-detection S4 operations all prefera- 
bly rely upon "ranges" or otherwise allow some variation 
in connection with the identification of potential mark 
constituents and potential security marks in terms of 
color, size, shape, and the like, it is possible that one or 
more of the potential mark constituents PMC defining a 
potential security mark PSM are not actual mark constit- 
uents MC. Of course, in such case, the potential secu- 
rity mark PSM would not be an actual security mark SM. 
Thus, to ensure that a potential security mark PSM is an 
actual security mark SM, the potential security mark is 
subjected to a verification operation S5 in accordance 
with the present invention. More particularly, for each 
potential security mark PSM, a verification sub-step 
S5a-1 examines the color of each potential mark con- 
stituent PMC defining the potential security mark PSM, 
and determines if the color of each potential mark con- 



stituent is sufficiently close to or uniform with the color of 
the other potential mark constituents PMC defining the 
potential security mark PSM. It is preferred that the 
potential mark constituents have a color that is equal or 

5 close to each other. For example, if two potential mark 
constituents PMC have respective colors that fall within 
the color range used in the binarization color-checking 
sub-step S2a, but the respective colors thereof are 
found at extreme opposite ends of the acceptable color 

10 range, such potential mark constituents will not be 
deemed to exhibit sufficient color uniformity relative to 
each other to be actual mark constituents MC. Any 
potential security marks PSM not satisfying the color 
uniformity verification sub-step S5a-1 are discarded by 

j 5 the sub-step S5c. 

[0036] For potential security marks PSM satisfying 
the color uniformity verification sub-step S5a-1, a 
dimensional uniformity verification sub-step S5a-2 
examines the potential mark constituents PMC for 

20 dimensional uniformity relative to each other. The 
dimensional uniformity verification sub-step S5a-2 
examines the column width and/or row height of each 
potential mark constituent PMC defining the potential 
security mark PSM for purposes of ensuring that the 

25 dimensions of the potential mark constituents are con- 
sistent relative to each other. Again, for example, if one 
potential mark constituent PMC exhibits dimensional 
characteristics relative to other potential mark constitu- 
ents that vary by +/- 5%, the potential mark constituent 

30 will fail the dimensional uniformity verification sub-step 
S5a-2, and the sub-step S5c will discard the relevant 
potential security mark PSM. If the potential mark con- 
stituents PMC defining a potential security mark PSM 
satisfy the verification operation S5, a sub-step S5B 

35 identifies the potential security mark PSM as an actual 
security mark SM. 

[0037] Subsequent to the verification operation S5, 
a prevention operation S6 operates to prevent effective 
reproduction of the document scanned by the image 

40 input scanner 12. A sub-step S6a determines if an 
actual security mark SM has been identified as present 
in the document being scanned by the input scanner 12. 
If no security mark SM has been found, reproduction of 
the document is permitted. If, on the other hand, a secu- 

45 rity mark SM is identified, a prevention sub-step S6b 
prevents effective duplication of the document scanned 
by the input scanner 1 2. This is accomplished using one 
or more suitable prevention operations such as disa- 
bling the image output device 16, not sending output 

so data from the image processing unit 14 to the image 
output device 16, embedding or otherwise including a 
message (such as VOID) in the image data sent to the 
image output device 16 so that the message is visible in 
the document reproduction, or by any other suitable 

55 method that prevents an effective reproduction of the 
document scanned by the input scanner 12. 
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Claims 

1 . A method of digital image processing comprising: 

(a) for a printed document potentially including 5 
a security mark defined therein by a plurality of 
actual mark constituents each having a select 
color, size, and shape and having a select spa- 
tial arrangement relative to each other, scan- 
ning said document to obtain digital image data 10 
corresponding to said printed document, said 
digital image data defined in terms of a plurality 

of color input pixel values; 

(b) processing said digital image data to iden- 
tify all portions representing potential constitu- 15 
ents of a security mark; 

(c) for each potential mark constituent repre- 
sented by said digital image data, determining 
if said potential mark constituent, together with 

at least one other potential mark constituent 20 
represented by said digital image data, defines 
a potential security mark; 

(d) for each potential security mark repre- 
sented in said digital image data, determining if 
said potential security mark represents an 25 
actual security mark present in said printed 
document. 

2. A digital image processing method for preventing 
unauthorized reproduction of a printed document 30 
including a security mark defined in terms of a plu- 
rality of actual mark constituents having a select 
color, select dimensions and arranged in a select 
pattern relative to each other, said method compris- 
ing: 35 

a. scanning said printed document to derive 
color digital data representing said printed doc- 
ument, said color digital data defined in terms 

of a plurality of pixels each having a color 40 
value; 

b. identifying all pixels of said color digital data 
having a color value representing a color at 
least approximating said select color of said 
plurality of actual mark constituents; 45 

c. constructing a binary map of said color dig- 
ital data defined in terms of "on" and "off pix- 
els, said "on B pixels corresponding to said 
identified pixels of said color digital data having 
color values at least approximating said select so 
color of said plurality of actual mark constitu- 
ents; 

d. using said binary map, identifying potential 
mark constituents defined by said "on" pixels; 

e. using said binary map, identifying at least 55 
one neighborhood of plural potential mark con- 
stituents together defining a potential security 
mark; 



f. identifying said potential security mark as an 
actual security mark if said potential mark con- 
stituents thereof are uniform relative to each 
other; and 

g. preventing effective duplication of said 
printed document if an actual security mark is 
identified. 

3. A method of processing digital image data repre- 
senting a color printed document that includes a 
security mark for purposes of identifying the secu- 
rity mark represented in said digital image data, 
said method comprising: 

a. processing said digital image data to identify 
all portions thereof defining a select color cor- 
responding to the color of the security mark in 
said printed document; 

b. for each portion of said digital image data 
defining the select color, determining if the por- 
tion represents a potential constituent of a 
security mark in said printed document; 

c. for each potential security mark constituent 
identified in said digital image data, determin- 
ing if said potential security mark constituent, 
together with at least one other potential secu- 
rity mark constituent, defines a potential secu- 
rity mark in said digital image data; 

d. comparing the potential security mark con- 
stituents defining each potential security mark 
to each other to determine if they are uniform in 
terms of color and size relative to each other; 
and 

e. identifying a potential security mark as a 
security mark represented in said digital image 
data if the potential security mark constituents 
of said potential security mark are sufficiently 
uniform in terms of the least color and size rel- 
ative to each other 
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